Modeling emergency department visit patterns for infectious disease complaints: results and application to disease surveillance

BACKGROUND: Concern over bio-terrorism has led to recognition that traditional public health surveillance for specific conditions is unlikely to provide timely indication of some disease outbreaks, either naturally occurring or induced by a bioweapon. In non-traditional surveillance, the use of health care resources are monitored in "near real" time for the first signs of an outbreak, such as increases in emergency department (ED) visits for respiratory, gastrointestinal or neurological chief complaints (CC). METHODS: We collected ED CCs from 2/1/94 – 5/31/02 as a training set. A first-order model was developed for each of seven CC categories by accounting for long-term, day-of-week, and seasonal effects. We assessed predictive performance on subsequent data from 6/1/02 – 5/31/03, compared CC counts to predictions and confidence limits, and identified anomalies (simulated and real). RESULTS: Each CC category exhibited significant day-of-week differences. For most categories, counts peaked on Monday. There were seasonal cycles in both respiratory and undifferentiated infection complaints and the season-to-season variability in peak date was summarized using a hierarchical model. For example, the average peak date for respiratory complaints was January 22, with a season-to-season standard deviation of 12 days. This season-to-season variation makes it challenging to predict respiratory CCs so we focused our effort and discussion on prediction performance for this difficult category. Total ED visits increased over the study period by 4%, but respiratory complaints decreased by roughly 20%, illustrating that long-term averages in the data set need not reflect future behavior in data subsets. CONCLUSION: We found that ED CCs provided timely indicators for outbreaks. Our approach led to successful identification of a respiratory outbreak one-to-two weeks in advance of reports from the state-wide sentinel flu surveillance and of a reported increase in positive laboratory test results

Time series modeling for syndromic surveillance

BACKGROUND: Emergency department (ED) based syndromic surveillance systems identify abnormally high visit rates that may be an early signal of a bioterrorist attack. For example, an anthrax outbreak might first be detectable as an unusual increase in the number of patients reporting to the ED with respiratory symptoms. Reliably identifying these abnormal visit patterns requires a good understanding of the normal patterns of healthcare usage. Unfortunately, systematic methods for determining the expected number of (ED) visits on a particular day have not yet been well established. We present here a generalized methodology for developing models of expected ED visit rates. METHODS: Using time-series methods, we developed robust models of ED utilization for the purpose of defining expected visit rates. The models were based on nearly a decade of historical data at a major metropolitan academic, tertiary care pediatric emergency department. The historical data were fit using trimmed-mean seasonal models, and additional models were fit with autoregressive integrated moving average (ARIMA) residuals to account for recent trends in the data. The detection capabilities of the model were tested with simulated outbreaks. RESULTS: Models were built both for overall visits and for respiratory-related visits, classified according to the chief complaint recorded at the beginning of each visit. The mean absolute percentage error of the ARIMA models was 9.37% for overall visits and 27.54% for respiratory visits. A simple detection system based on the ARIMA model of overall visits was able to detect 7-day-long simulated outbreaks of 30 visits per day with 100% sensitivity and 97% specificity. Sensitivity decreased with outbreak size, dropping to 94% for outbreaks of 20 visits per day, and 57% for 10 visits per day, all while maintaining a 97% benchmark specificity. CONCLUSIONS: Time series methods applied to historical ED utilization data are an important tool for syndromic surveillance. Accurate forecasting of emergency department total utilization as well as the rates of particular syndromes is possible. The multiple models in the system account for both long-term and recent trends, and an integrated alarms strategy combining these two perspectives may provide a more complete picture to public health authorities. The systematic methodology described here can be generalized to other healthcare settings to develop automated surveillance systems capable of detecting anomalies in disease patterns and healthcare utilization

Evaluation of SOVAT: An OLAP-GIS decision support system for community health assessment data analysis

Background. Data analysis in community health assessment (CHA) involves the collection, integration, and analysis of large numerical and spatial data sets in order to identify health priorities. Geographic Information Systems (GIS) enable for management and analysis using spatial data, but have limitations in performing analysis of numerical data because of its traditional database architecture. On-Line Analytical Processing (OLAP) is a multidimensional datawarehouse designed to facilitate querying of large numerical data. Coupling the spatial capabilities of GIS with the numerical analysis of OLAP, might enhance CHA data analysis. OLAP-GIS systems have been developed by university researchers and corporations, yet their potential for CHA data analysis is not well understood. To evaluate the potential of an OLAP-GIS decision support system for CHA problem solving, we compared OLAP-GIS to the standard information technology (IT) currently used by many public health professionals. Methods. SOVAT, an OLAP-GIS decision support system developed at the University of Pittsburgh, was compared against current IT for data analysis for CHA. For this study, current IT was considered the combined use of SPSS and GIS ("SPSS-GIS"). Graduate students, researchers, and faculty in the health sciences at the University of Pittsburgh were recruited. Each round consisted of: an instructional video of the system being evaluated, two practice tasks, five assessment tasks, and one post-study questionnaire. Objective and subjective measurement included: task completion time, success in answering the tasks, and system satisfaction. Results. Thirteen individuals participated. Inferential statistics were analyzed using linear mixed model analysis. SOVAT was statistically significant (α = .01) from SPSS-GIS for satisfaction and time (p < .002). Descriptive results indicated that participants had greater success in answering the tasks when using SOVAT as compared to SPSS-GIS. Conclusion. Using SOVAT, tasks were completed more efficiently, with a higher rate of success, and with greater satisfaction, than the combined use of SPSS and GIS. The results from this study indicate a potential for OLAP-GIS decision support systems as a valuable tool for CHA data analysis. © 2008 Scotch et al; licensee BioMed Central Ltd

Surveillance of febrile patients in a district and evaluation of their spatiotemporal associations: a pilot study

<p>Abstract</p> <p>Background</p> <p>Fever is an undifferentiated clinical feature that may enhance the sensitivity of syndromic surveillance systems. By studying the spatiotemporal associations of febrile patients, it may allow early detection of case clustering that indicates imminent threat of infectious disease outbreaks in the community.</p> <p>Methods</p> <p>We captured consecutive emergency department visits that led to hospitalization in a district hospital in Hong Kong during the period of 12 Sep 2005 to 14 Oct 2005. We recorded demographic data, provisional diagnoses, temperature on presentation and residential location for each patient-episode, and geocoded the residential addresses. We applied Geographical Information System technology to study the geographical distribution these cases, and their associations within a 50-m buffer zone spatially. A case cluster was defined by three or more spatially associated febrile patients within each three consecutive days.</p> <p>Results</p> <p>One thousand and sixty six patient-episodes were eligible for analysis; 42% of them had fever (>37°C; oral temperature) on presentation. Two hundred and four patient-episodes (19.1%) came from residential care homes for elderly (RCHE). We detected a total of 40 case clusters during the study period. Clustered cases were of older age; 57 (33.3%) were residents of RCHE. We found a median of 3 patients (range: 3 - 8) and time span of 3 days (range: 2 - 8 days) in each cluster. Twenty five clusters had 2 or more patients living in the same building block; 18 of them were from RCHE.</p> <p>Conclusions</p> <p>It is technically feasible to perform surveillance on febrile patients and studying their spatiotemporal associations. The information is potentially useful for early detection of impending infectious disease threats.</p

CASE: A Framework for Computer Supported Outbreak Detection

Background: In computer supported outbreak detection, a statistical method is applied to a collection of cases to detect any excess cases for a particular disease. Whether a detected aberration is a true outbreak is decided by a human expert. We present a technical framework designed and implemented at the Swedish Institute for Infectious Disease Control for computer supported outbreak detection, where a database of case reports for a large number of infectious diseases can be processed using one or more statistical methods selected by the user. Results: Based on case information, such as diagnosis and date, different statistical algorithms for detecting outbreaks can be applied, both on the disease level and the subtype level. The parameter settings for the algorithms can be configured independently for different diagnoses using the provided graphical interface. Input generators and output parsers are also provided for all supported algorithms. If an outbreak signal is detected, an email notification is sent to the persons listed as receivers for that particular disease. Conclusions: The framework is available as open source software, licensed under GNU General Public License Version 3. By making the code open source, we wish to encourage others to contribute to the future development of computer supported outbreak detection systems, and in particular to the development of the CASE framewor

Online detection and quantification of epidemics

<p>Abstract</p> <p>Background</p> <p>Time series data are increasingly available in health care, especially for the purpose of disease surveillance. The analysis of such data has long used periodic regression models to detect outbreaks and estimate epidemic burdens. However, implementation of the method may be difficult due to lack of statistical expertise. No dedicated tool is available to perform and guide analyses.</p> <p>Results</p> <p>We developed an online computer application allowing analysis of epidemiologic time series. The system is available online at <url>http://www.u707.jussieu.fr/periodic_regression/</url>. The data is assumed to consist of a periodic baseline level and irregularly occurring epidemics. The program allows estimating the periodic baseline level and associated upper forecast limit. The latter defines a threshold for epidemic detection. The burden of an epidemic is defined as the cumulated signal in excess of the baseline estimate. The user is guided through the necessary choices for analysis. We illustrate the usage of the online epidemic analysis tool with two examples: the retrospective detection and quantification of excess pneumonia and influenza (P&I) mortality, and the prospective surveillance of gastrointestinal disease (diarrhoea).</p> <p>Conclusion</p> <p>The online application allows easy detection of special events in an epidemiologic time series and quantification of excess mortality/morbidity as a change from baseline. It should be a valuable tool for field and public health practitioners.</p

Perceived usefulness of a distributed community-based syndromic surveillance system: a pilot qualitative evaluation study

<p>Abstract</p> <p>Background</p> <p>We conducted a pilot utility evaluation and information needs assessment of the Distribute Project at the 2010 Washington State Public Health Association (WSPHA) Joint Conference. Distribute is a distributed community-based syndromic surveillance system and network for detection of influenza-like illness (ILI). Using qualitative methods, we assessed the perceived usefulness of the Distribute system and explored areas for improvement. Nine state and local public health professionals participated in a focus group (<it>n = 6</it>) and in semi-structured interviews (<it>n = 3</it>). Field notes were taken, summarized and analyzed.</p> <p>Findings</p> <p>Several emergent themes that contribute to the perceived usefulness of system data and the Distribute system were identified: 1) <it>Standardization: </it>a common ILI syndrome definition; 2) <it>Regional Comparability: </it>views that support county-by-county comparisons of syndromic surveillance data; 3) <it>Completeness: </it>complete data for all expected data at a given time; <it>4) Coverage: </it>data coverage of all jurisdictions in WA state; 5) <it>Context: </it>metadata incorporated into the views to provide context for graphed data; 6) <it>Trusted Data</it>: verification that information is valid and timely; and 7) <it>Customization: </it>the ability to customize views as necessary. As a result of the focus group, a new county level health jurisdiction expressed interest in contributing data to the Distribute system.</p> <p>Conclusion</p> <p>The resulting themes from this study can be used to guide future information design efforts for the Distribute system and other syndromic surveillance systems. In addition, this study demonstrates the benefits of conducting a low cost, qualitative evaluation at a professional conference.</p

Using Ontario's "Telehealth" health telephone helpline as an early-warning system: a study protocol

BACKGROUND: The science of syndromic surveillance is still very much in its infancy. While a number of syndromic surveillance systems are being evaluated in the US, very few have had success thus far in predicting an infectious disease event. Furthermore, to date, the majority of syndromic surveillance systems have been based primarily in emergency department settings, with varying levels of enhancement from other data sources. While research has been done on the value of telephone helplines on health care use and patient satisfaction, very few projects have looked at using a telephone helpline as a source of data for syndromic surveillance, and none have been attempted in Canada. The notable exception to this statement has been in the UK where research using the national NHS Direct system as a syndromic surveillance tool has been conducted. METHODS/DESIGN: The purpose of our proposed study is to evaluate the effectiveness of Ontario's telephone nursing helpline system as a real-time syndromic surveillance system, and how its implementation, if successful, would have an impact on outbreak event detection in Ontario. Using data collected retrospectively, all "reasons for call" and assigned algorithms will be linked to a syndrome category. Using different analytic methods, normal thresholds for the different syndromes will be ascertained. This will allow for the evaluation of the system's sensitivity, specificity and positive predictive value. The next step will include the prospective monitoring of syndromic activity, both temporally and spatially. DISCUSSION: As this is a study protocol, there are currently no results to report. However, this study has been granted ethical approval, and is now being implemented. It is our hope that this syndromic surveillance system will display high sensitivity and specificity in detecting true outbreaks within Ontario, before they are detected by conventional surveillance systems. Future results will be published in peer-reviewed journals so as to contribute to the growing body of evidence on syndromic surveillance, while also providing an non US-centric perspective

Nationwide Surveillance of Influenza during the Pandemic (2009–10) and Post-Pandemic (2010–11) Periods in Taiwan

INTRODUCTION: Although WHO declared the world moving into the post-pandemic period on August 10, 2010, influenza A(H1N1) 2009 virus continued to circulate globally. Its impact was expected to continue during the 2010-11 influenza season. This study describes the nationwide surveillance findings of the pandemic and post-pandemic influenza periods in Taiwan and assesses the impact of influenza A(H1N1) 2009 during the post-pandemic period. METHODS: The Influenza Laboratory Surveillance Network consisted of 12 contract laboratories for collecting and testing samples with acute respiratory tract infections. Surveillance of emergency room visits and outpatient department visits for influenza-like illness (ILI) were conducted using the Real-Time Outbreak and Disease Surveillance system and the National Health Insurance program data, respectively. Hospitalized cases with severe complications and deaths were reported to the National Notifiable Disease Surveillance System. RESULTS: During the 2009-10 influenza season, pandemic A(H1N1) 2009 was the predominant circulating strain and caused 44 deaths. However, the 2010-11 influenza season began with A(H3N2) being the predominant circulating strain, changing to A(H1N1) 2009 in December 2010. Emergency room and outpatient department ILI surveillance displayed similar trends. By March 31, 2011, there were 1,751 cases of influenza with severe complications; 50.1% reported underlying diseases. Of the reported cases, 128 deaths were associated with influenza. Among these, 93 (72.6%) were influenza A(H1N1) 2009 and 30 (23.4%) A(H3N2). Compared to the pandemic period, during the immediate post-pandemic period, increased number of hospitalizations and deaths were observed, and the patients were consistently older. CONCLUSIONS: Reemergence of influenza A(H1N1) 2009 during the 2010-11 influenza season had an intense activity with age distribution shift. To further mitigate the impact of future influenza epidemics, Taiwan must continue its multifaceted influenza surveillance systems, remain flexible with antiviral use policies, and revise the vaccine policies to include the population most at risk

The Tell-Tale Heart: Population-Based Surveillance Reveals an Association of Rofecoxib and Celecoxib with Myocardial Infarction

Background. COX-2 selective inhibitors are associated with myocardial infarction (MI). We sought to determine whether population health monitoring would have revealed the effect of COX-2 inhibitors on population-level patterns of MI. Methodology/Principal Findings. We conducted a retrospective study of inpatients at two Boston hospitals, from January 1997 to March 2006. There was a population-level rise in the rate of MI that reached 52.0 MI-related hospitalizations per 100,000 (a two standard deviation exceedence) in January of 2000, eight months after the introduction of rofecoxib and one year after celecoxib. The exceedence vanished within one month of the withdrawal of rofecoxib. Trends in inpatient stay due to MI were tightly coupled to the rise and fall of prescriptions of COX-2 inhibitors, with an 18.5 % increase in inpatient stays for MI when both rofecoxib and celecoxib were on the market (P,0.001). For every million prescriptions of rofecoxib and celecoxib, there was a 0.5 % increase in MI (95%CI 0.1 to 0.9) explaining 50.3 % of the deviance in yearly variation of MI-related hospitalizations. There was a negative association between mean age at MI and volume of prescriptions for celecoxib and rofecoxib (Spearman correlation, 20.67, P,0.05). Conclusions/Significance. The strong relationship between prescribing and outcome time series supports a population-level impact of COX-2 inhibitors on MI incidence. Further, mean age at MI appears to have been lowered by use of these medications. Use of a population monitoring approach as an adjunct t